# Low-precision Inference

This is the GGUF format conversion version of the BAAI/bge-reranker-v2-gemma model, compatible with the llama.cpp framework, supporting multilingual text classification tasks.